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Abstract 


The Parents as Teachers (PAT) program is a parent-education program that includes 
home visiting and is designed to begin prenatally or at birth. Through home visits, vis- 
itors called parent educators help parents to strengthen their parenting skills and 
knowledge of child development and to prepare young children for school. This arti- 
cle describes the PAT program and reports the results of evaluations of two random- 
ized trials of PAT: (1) the Northern California (Salinas Valley) Parents as Teachers 
Demonstration, which served primarily Latino parents in the Salinas Valley of 
California’s Monterey County; and (2) the Teen Parents as Teachers Demonstration, 
which served adolescent parents in four counties in Southern California. 


The two evaluations revealed small and inconsistent positive effects on parent knowl 
edge, attitudes, and behavior, and no gains in child development or health, when analy- 
ses compared the experimental and control groups overall. However, subgroup 
analyses in the Salinas Valley program indicated that children in primarily Spanish- 
speaking Latino families benefitted more than either non-Latino or English-speaking 
Latino families, with significant gains in cognitive, communication, social, and self-help 
development. Subgroup analyses in the Teen PAT Demonstration indicated that fami- 
lies that received both PAT services and comprehensive case management services 
designed to help mothers improve their life course benefitted most. Subgroup analyses 
in the Salinas Valley study suggested that children in families that received more inten- 
sive services benefitted more than children whose families received less intensive ser 
vices. Results from that study suggested that home visits produced about a one-month 
developmental advantage per 10 visits for participating children. 


ome visiting has broad appeal as a delivery mechanism for provid- 
ing many kinds of child and family services. Visiting families in 
their homes can give visitors a holistic view of each child and family, 
which can help the visitors tailor services to meet family needs. Home visits 
also can accommodate families’ schedules, encouraging the participation of 
families that might be unable to attend programs with more structured and 
less individualized schedules. The Parents as Teachers (PAT) program is an 
example of a widely implemented, universal-access home visiting program 
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that emphasizes positive parenting behavior as the vehicle to achieve devel- 
opmental benefits for children. Major goals of PAT include increasing 
parents’ knowledge of child development, preparing young children for 
success in school, and increasing parents’ feelings of competence and 
confidence.! 


To achieve its goals, the PAT program uses individual, home-based 
instruction and group interactions to inform parents about principles of 
child development and good parenting practices. Trained and certified 
parent educators use a standard curriculum in the home visits, which can 
begin prenatally. The curriculum emphasizes different developmental 
stages through the first three years of life. Additional curricular materials 
(developed after the demonstration projects described in this article were 
begun) meet the particular needs of parents of three- to five-year-olds, par- 
ents who are teenagers, and parents whose children attend child care cen- 
ters. Improved knowledge is expected to help parents feel competent in 
their roles and to provide the environments and personal interactions with 
their children that will support positive child development. Healthy, well- 
developed children who are ready for school are the ultimate intended 
result. 


PAT has enjoyed wide implementation and rapid growth. Begun in 
Missouri in 1981, the program has expanded to serve more than 500,000 
families in more than 2,000 sites in 49 states and six foreign countries.? (See 
Appendix B in this journal issue for an additional description of PAT.) In 
addition to the general appeal of home visiting as a service approach, the 
popularity of PAT is due in part to the inherent attractiveness of its basic 
premises: “that babies are born learning and that parents are their first and 
most influential teachers.”> Also, the use of parent educators with a wide 
range of backgrounds and the provision of, for the most part, monthly ser- 
vices make PAT a relatively inexpensive program model to implement! com- 
pared with interventions that rely on nurses’ or that have centerbased, 
child-focused components in broader two-generation program models.® 


In 1990, the California legislature provided statutory authorization for a 
grant program to implement PAT in selected counties in the state,” and 
articulated the specific intention that it should be targeted to families with 
parents who had limited English proficiency and to those with parents who 
were teenagers. Although quasi-experimental studies of PAT in Missouri had 
indicated benefits for children, the effectiveness of PAT for these particular 
groups had not been demonstrated. (See Appendix B in this journal issue 
for a description of other research studies concerning PAT.) Two research 
studies were launched to evaluate PAT’s effectiveness with these popula- 
tions: the Northern California (Salinas Valley) PAT Demonstration, which 
focused on Latino families; and the Teen PAT Demonstration.’ Evaluations 
of both demonstrations were conducted by SRI International. 


These demonstrations were designed to specifically address the question 
of targeting PAT to limited English proficient and teen parent families, and 
also to overcome general weaknesses in the research base of PAT. An expert 
panel? called together to review PAT and related research!? identified the 
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following limitations to the research base and corresponding future 
research needs: 


@ More rigorous research designs. Much of what is known about PAT 
results from quasi-experimental research!! and research with small sam- 
ples,!* a state of research common to the home visiting arena more 
broadly.!’ Given PAT’s expansion, experimentally based results are 
needed to have the required credibility to influence the national policy 
arena. 


m@ Research regarding PAT’s effectiveness for low-income, minority, and at- 
risk families. Many of the studies of PAT’s effectiveness have been con- 
ducted with working- or middle-class white families and/or in nonurban 
areas.!+ Although generally positive, these results do not provide evidence of 
PAT’s effectiveness for low-income and minority families or for those at risk 
of poor outcomes. Addressing this gap in the knowledge base regarding 
PAT overlaps well with determining whether targeting PAT to teen parents 
and those with limited English proficiency is warranted by its effectiveness 
with those groups. 


™ Research regarding the dimensions of program effectiveness. 
Replicating effective program dimensions requires understanding what it is 
about the programs that works. Are there thresholds of service intensity that 
must be met for programs to be effective? To what extent does impact relate 
to staff characteristics, quality, and training? The expert panel identified the 
need to illuminate the “black box” of the PAT program so that the contri- 
bution of its various elements is understood. 


This article reports the results of the Salinas Valley PAT and Teen PAT 
Demonstrations. Each of the demonstrations is described, including a 
review of the program model, enrolled families, and the extent to which 
families were lost to the demonstrations through attrition. Then findings for 
the full sample of families in each demonstration are presented. Following 
this is a discussion of the effectiveness of targeting parents with limited 
English proficiency, using data from the Salinas Valley PAT Demonstration 
to focus explicitly on results for families with Latina mothers and distin- 
guishing those who spoke primarily Spanish from those who were primarily 
English speakers or bilingual. Finally, variations in exposure to PAT among 
enrolled families and the relationship of these variations to outcomes for 
parents and children are considered. 


Program Descriptions 


The Northern California (Salinas 
Valley) Parents as Teachers 
Demonstration 


A consortium of school districts!’ sponsored 
implementation of the PAT program in the 
Salinas Valley of California, beginning with a 
two-year pilot phase in 1990,!° continuing 
with the launching of the randomized trial 
proper in 1992, and concluding with the 


“graduation” of participating families in 
1996, when children reached their third 
birthdays.!” 


The Salinas Valley, in north Monterey 
County, is a largely agricultural area with 
a high demand for seasonal farm labor and a 
predominantly Latino population. The unem- 
ployment rate in the county at the time of 
the demonstration was among the highest 
in the state—15.1% in March 1995, com- 
pared with 7.8% for the state as a whole.!8 
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Figure 1 


Conceptual Framework of the Salinas Valley Parents as Teachers (PAT) Demonstration 


Individual/Family Characteristics, Family Life Course 


re ee 


PAT Program Participation Parent Impacts Child Impacts 
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* “Drop in and play” practices/child parenting behaviors * Cognitive 
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environment for ¢ Motor 
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Related Program Experience —_> 
Child care/preschool 
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Source: Wagner, M., Clayton, S., Gerlach-Downie, S., and McElroy, M. An evaluation of the Northern California Parents as Teachers Demonstration: Review draft. 
Menlo Park, CA: SRI International, 1997, p. 1-6. 


The conceptual framework for the 
Northern California (Salinas Valley) Parents 
as Teachers (or Salinas Valley PAT) Demon- 
stration and evaluation, illustrated in Figure 
1, includes the key parent and child out 
comes expected from the program and 
reflects the underlying assumption of the 
program: that participation in PAT services 
will change parent behavior and thereby 
enhance children’s development. 


Families with children no older than six 
months were recruited to the demonstration 
by local program staff over a one-year period. 
Recruitment sites included the local Women, 
Infants, and Children (WIC) office; medical 
clinics; and school districts. During the pilot 
phase, attrition from the PAT group had 
been higher than attrition from the control 
group. Therefore, to ensure sufficient num- 
bers of families in each group at the end of 
the study, SRI staff randomly assigned 497 
families to the participant and control 
groups, with a 60% probability of assignment 


to the participant group (n=298) and a 40% 
probability of assignment to the control 
group (n=199).!9 There were no statistically 
significant differences between the partici- 
pant and control groups at enrollment, as 
shown in Table 1, or at any assessment point.!9 


These families reflected their commu- 
nity. A large majority of families had Latina 
mothers, many of whom spoke primarily 
Spanish. Many families were low income, 
with about one in five receiving Aid to 
Families with Dependent Children (AFDC) 
benefits and more than half covered by 
Medi-Cal. Nearly half of the families were 
headed by unmarried mothers. 


Program Services 

The PAT group was offered monthly home 
visits for as long as the families chose to 
remain in the program, up to the children’s 
third birthdays. Each home visit, conducted 
by a trained parent educator, covered a lesson 
from the national PAT curriculum. All of the 
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Table 1] 


Mothers’ Characteristics at Enrollment in Parents as Teachers (PAT), 
by Group 


© Statistically significant difference from the control group in a two-tailed test at the p<.05 level. 


Salinas Valley PAT Teen PAT 
haracteristi 
Eharartadelies Control Control Case Combined 
PAT Group PAT Group | Management |_ Intervention 
Average Age 25.3 25.9 16.6 16.8 16.6 16.6 
Ethnic/Language Background“ 
Latina 83.6% 76.9% 57.1% 55.1% 52.6% 59.4% 
Caucasian? 16.5% 23.1% 20.3% 19.1% 25.4% 18.3% 
African American _— — 18.1% 24.2% 17.9% 21.1% 
Other _— — 4.5% 1.7% 4.0% 1.1% 
Spoke mostly Spanish 45.7% 44.5% 20.9% 21.9% 19.6% 21.1% 
Economic Status 
Received AFDC 20.5% 20.6% 32.2% 36.5% 27.6% 29.2% 
Participated in Medi-Cal 61.7% 59.3% — — —_ _— 
Worked or was in job training 24.5% 22.1% 5.1% 11.2% 9.8% 9.8% 
Percentage Who Were Enrolled in or 41.6% 41.7% 65.3%°| 75.3% 70.5% 67.4% 
Had Completed High School 
Household Composition 
Married 56.0% 58.3% 16.6% 11.2% 9.9% 12.0% 
Only adult in household 10.1% 12.1% 1.7% 0.6% 1.2% 1.1% 
Percentage Who Enrolled While 49.8% 46.9% 57.6% 55.6% 52.6% 59.4% 
Pregnant 
Percentage Who Reported Knowing 14.9% 9.1% 32.4% 27.5% 25.3% 31.6% 
“A Lot” About Infants 
Sample size 298 199 177 178 174 175 
a Percentages may not total 100% due to rounding. 
© In the Salinas Valley PAT study, this category included all non-Latina mothers, the majority of whom were Caucasian. 


10 parent educators who worked in the pro- _ family crisis interventions such as counseling 
gram during the course of the demonstration or battered women’s shelters. 
project had at least some college education; 
six had bachelor’s degrees or better. Six were PAT program participants received an 
Latinas who spoke both English and Spanish. average of 20 visits over three years. Visits 
were planned to last from 45 to 60 minutes, 
Mothers were the primary program par- but a sample of home visits that were video- 
ticipants, occasionally joined by other family — taped ranged in length from 28 to 50 min- 
members. The enrolled children were utes depending on the parent educator”? 
included in the visits so the parent educators Voluntary group meetings in English and 
could model appropriate ways of interacting Spanish were offered periodically by parent 
with the children. At the close of the lessons, | educators, during which parents discussed 
the parent educators often left materials that issues with and received social support from 
reinforced or supplemented the lessons for the parent educators and other parents. 
the parents to read and share with other However, less than 15% of participant group 
family members. Parent educators also con- families attended any group meeting. 
ducted periodic screenings of children’s 
hearing, vision, and general development, Control Group Services 
and made referrals to community services— The evaluation team periodically sent age- 
for example, for child care, health care,and appropriate toys to the control group as a 
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method of tracking their location and 
encouraging participation in the assess- 
ments. If annual assessments conducted for 
the purpose of the evaluation revealed sig- 
nificant developmental delays or other prob- 
lems, families were referred to appropriate 
services. Other than that, the only services 
control group families received were those 
that they sought on their own from existing 
community health and human services 
providers. 


Assessments of (1) parent knowledge, 
attitudes, and behavior; (2) child develop- 
ment; and (3) the conduciveness of the 
home environment to promoting child 
development were conducted in families’ 
homes at children’s first, second, and third 
birthdays by SRI field evaluators who were 
hired, trained, and supervised by SRI and 
were unaware of the group assignments of 
the families they assessed. In addition, fami- 
lies were invited to bring their children on a 
voluntary basis to the Monterey County 
Office of Education for annual developmen- 
tal assessments by child psychologists using 
the Bayley Scales of Infant Development 
(BSID).?! 


The Teen Parents as Teachers 
Demonstration 

The Teen PAT Demonstration was spon- 
sored by a public-private partnership initi- 
ated in 1991.72 The conceptual model for 
Teen PAT is illustrated in Figure 2. Designed 
to test the effects of a two-generation 
approach to social service delivery to families 


and children, the program combined PAT 
services with comprehensive case manage- 
ment services for the participating teen par- 
ents to produce positive life changes for 
both parents and children. Both a case man- 
ager and a PAT parent educator served each 
family in this “combined intervention.” Case 
management activities focused on achieving 
positive outcomes in the teen mothers’ lives, 
particularly related to education and post- 
poned repeat childbearing. (See the article 
by St.Pierre and Layzer in this journal issue 
for a discussion of another two-generation 
program.) Because the effectiveness of the 
individual interventions for teens was 
unknown, the demonstration also included 
stand-alone PAT and case management 
intervention groups. 


Teen PAT Demonstration sites in Los 
Angeles, San Bernardino, San Diego, and 
Santa Barbara Counties were selected 
through a competitive bid process. Appli- 
cants were agencies with established pro- 
grams of case management for teen parents 
and the willingness to recruit and randomly 
assign up to 200 teens over the course of a 
year to one of four experimental conditions. 
Agencies also were responsible for the hiring 
and supervision of PAT-trained parent edu- 
cators. The sponsoring agencies at the sites 
differed (for example, three were youth- 
serving organizations, whereas one was a 
partnership between a public health depart- 
ment and the YWCA), as did the communi- 
ties they served (for example, the largely 
African-American neighborhood of South 
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Figure 2 


Conceptual Framework of the Teen Parents as Teachers (PAT) Demonstration 


Individual/Family Characteristics 


Mother's and father’s age Household composition 
Ethnic background Mother's and father’s school status at 
Pregnancy status at enrollment enrollment, etc. 


re ee 
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Source: Wagner, M., Cameto, R., and Gerlach-Downie, S. Intervention in support of adolescent parents and their children: A final report on the Teen Parents 
as Teachers Demonstration. Menlo Park, CA: SRI International, 1996, p. 1-4. 


Central Los Angeles and largely Latino areas group (n=178). Table 1 illustrates that the 
in Santa Barbara). groups were equivalent at enrollment, with 
the exception that mothers in the PAT-alone 


Like the Salinas Valley PAT Demon- 
stration, the evaluation of the Teen PAT 
Demonstration used a randomized experi- 
mental design.** Teens were eligible if they 
were less than 19 years of age and either 
were pregnant or had babies who were less 
than six months of age. SRI randomly 
assigned eligible participants, recruited over 
a one-year period from the population of 
youths served by the program agencies, into 
four groups: (1) PAT program services alone 
(n=177), (2) case management services 
alone (n=174), (3) PAT services plus case 
management (the two-generation group) 
(n=175), and (4) an untreated control 


group were significantly more likely than 
control group mothers to have dropped out 
of high school. 


As Table 1 describes, the 704 enrolled 
Teen PAT families were fairly diverse ethni- 
cally and sociodemographically. About half 
of the mothers were Latina, with the remain- 
der being fairly evenly divided between 
African American and Caucasian. Mothers 
were between 15 and 18 years of age at 
enrollment, and the majority were enrolled 
in or had completed high school. Few moth- 
ers were married. Almost one-third of fami- 
lies received AFDC benefits. 
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Program Services 

The PAT and combined intervention 
groups were offered monthly home visits 
and PAT group meetings through the chil- 
dren’s second _ birthdays.*4 During these 
visits, as in Salinas Valley, trained parent 
educators covered lessons from the national 
PAT curriculum. On average, participants 
received 10 visits during the two-year 
period. Visits were planned to last about 
one hour, but data regarding the actual 
length of visits were not collected. Partici- 
pant attendance at group meetings was low, 
averaging two meetings for PAT group 
members and three meetings for members 
of the combined intervention group over 
two years. 


The case management and combined 
intervention groups were offered compre- 
hensive case management services modeled 
after those provided through California’s 
Adolescent Family Life Program, with face- 
to-face contacts provided as often as teens 


Attrition from the participant groups of both 
programs was high: 43% in Salinas Valley 
PAT over three years and an average of 
57% for the three Teen PAT interventions 
over two years. 


needed but at least quarterly. Case managers 
provided referrals or arranged for services 
to address issues such as psychological 
functioning, health status, nutrition, environ- 
mental risks, and educational and voca- 
tional goals. 


In the combined intervention group, 
the case management contacts, which could 
occur at home or elsewhere, were separate 
from the PAT program visits. On average, 
participants in the case management and 
combined intervention groups received 10 
case Management contacts in two years. 
This means that a teen mother in the com- 
bined intervention group received an aver- 
age of 20 in-person contacts from both PAT 
and case management staff during the 
course of the program. Additional tele- 
phone contacts with the teens averaged 6 
for the PAT group, 8 for the case manage- 
ment group, and 17 for the combined inter- 
vention group. 


Conirol Group Services 

As in the Salinas Valley study, the control 
group received toys as an incentive to main- 
tain contact with the program, and partici- 
pated in annual developmental assessments, 
but otherwise received only the services that 
were normally available in the communities 
and that they sought at their own initiative. 
Children and parents were assessed by SRI 
field evaluators in their homes at or around 
the children’s first and second birthdays. 


Attrition from the 
Demonstrations 


Attrition from the participant groups of 
both programs was high: 43% in Salinas 
Valley PAT over three years and an average 
of 57% for the three Teen PAT interventions 
over two years (58% in the PAT group, 63% 
in the case management group, and 52% in 
the combined intervention group). The 
evaluation components of both demonstra- 
tions, however, had extensive procedures for 
tracking families whether or not they con- 
tinued their participation in the programs. 
In addition, a monetary incentive was paid 
to families for completing each in-home 
assessment. 


Using these procedures, evaluation 
assessments were successfully completed at 
the children’s third birthdays for almost 
73% of the original sample in the Salinas 
Valley PAT Demonstration, including 70% 
of participant and 77% of control group 
members. Comprehensive analysis of the 
characteristics of families that remained in 
the program and the evaluation study 
revealed no significant differences from the 
original sample in terms of mothers’ and 
fathers’ age, ethnicity, or education; house- 
hold composition or economic status; child 
characteristics; or mothers’ previous experi- 
ence with infants. 


Attrition was much higher in the Teen 
PAT Demonstration evaluation. Data were 
collected for only 52% of the original Teen 
PAT families (51% of each intervention 
group and 54% of control group teens), 
despite the fact that families were followed 
only through children’s second _ birthdays. 
This higher attrition among teen parents 
reflects the general instability of teen popu- 
lations in these communities and the chal- 
lenge of retaining them in both program 
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services and the evaluation study. However, 
despite the high attrition rate, there were no 
significant differences between the teen par- 
ents who were retained in the program and 
evaluation study and the original sample in 
terms of the characteristics listed above. In 
both demonstrations, moving from the com- 
munity was the most common reason for 
attrition, accounting for 52% of Salinas 
Valley PAT participant dropouts and an aver- 
age of 22% of Teen PAT participant dropouts 
across the three intervention groups. 


Outcomes Measurement 
Overview 


The two demonstrations had many out- 
comes of interest in common, including 
those focused on child development and 
parenting knowledge, attitudes, and behavy- 
iors. In the Teen PAT Demonstration, the 
program’s affiliation with the California 
Office of Child Abuse Prevention enabled 
access to child abuse data that was not possi- 
ble in Salinas Valley PAT.* Outcomes were 
measured with the following instruments: 


@ Parenting knowledge—the percentage of 
items that were answered correctly on the 
57-item Knowledge of Infant Development 
Inventory (KIDI).*6 


B Parent attitudes—the Parenting Sense of 
Competence (PSOC) Scale,?’ a selfadminis- 
tered attitude inventory. Both the total score 
and two subscale scores regarding parental 
efficacy and satisfaction are reported. 


= Parenting behaviors—the Home Obser- 
vation for Measurement of the Environment 
(HOME) Inventory? for families of children 
ages birth to three, which assesses parenting 
practices using the following subscales: 
acceptance of child’s behavior, opportunity 
for stimulation, organization of the environ- 
ment, parental involvement, parental 
responsivity, and appropriate play materials. 
The HOME is based on parent reports and 
field evaluator observations. 


B Child development—the Developmental 
Profile II (DPII)*? cognitive, communica- 
tion, social development, self-help, and phys- 
ical development scales were used to assess 
these outcomes in both demonstrations. 
The DPII is based on parent reports and 
field evaluator observations. The Salinas 
Valley PAT study also used direct assessments 
by trained testers of children’s development: 
the BSID mental and physical development 
subscales* at ages one, two, and three years 
and the Peabody Picture Vocabulary Test 
(PPVT) at age three.*! 


@ Child health and health care—the chil- 
dren’s immunization histories were recorded 
from the yellow cards issued to parents by 
health care providers in California as a 
record of immunization types and dates. 
Use of health care services was assessed 
through annual interviews with parents. In 
the Teen PAT study, information about 
whether child abuse or neglect complaints 
had been filed with the child protective 
services agencies in the four participating 
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counties was obtained from those agencies 
with the help of one of the funding agen- 
cies, the California Office of Child Abuse 
Prevention. 


All instruments that could be selfadmin- 
istered by parents were offered in English 
and Spanish; they were either read and com- 
pleted by respondents or read aloud by field 
evaluators who recorded responses. 


In addition to these measures of out 
comes, demographic information was col 
lected by program staff at the time parents 
were enrolled. To assess actual exposure to 
the interventions, implementing agencies 
recorded the number of contacts of differ- 
ent types (home visits, telephone contacts, 
group meetings, and referrals) with each 
family during the demonstrations. 


Program Evaluation Results 

The evaluation results of the Salinas Valley 
and Teen PAT programs suggest that, 
when comparing PAT or PAT-plus-case- 
management groups with control groups, 


PAT had little effect on parenting 
knowledge, attitudes, or behaviors as 
measured in these demonstrations. 


PAT had little effect on parenting knowl 
edge, attitudes, or behaviors as measured 
in these demonstrations. Nor were signifi- 
cant effects noted on child health or health 
care. There is some evidence, however, 
that PAT improved children’s cognitive 
development and perhaps their social and 
selfhelp development. The following sec- 
tion describes the major program evalu- 
ation results.*? 


Parent Knowledge, Attitudes, 
and Behavior, and the Home 
Environment 


Despite the fact that increasing parents’ 
understanding of parenting and child 
development was the main focus of PAT 
home visits, Table 2 shows that no benefit 
emerged in terms of parenting knowledge 
for the full sample in either program. 
Changes in parenting attitudes also were 
small and inconsistent in direction. In 


terms of parenting behavior, although the 
combined intervention group of the Teen 
PAT Demonstration had a positive and sig- 
nificant impact on the HOME subscale that 
measures acceptance of children’s behav- 
ior, a negative effect of similar magnitude 
was noted on that same subscale in the 
Salinas Valley PAT group (in other words, 
the control group outperformed the PAT 
group on that subscale). The only other 
notable program effect, reflecting the avail- 
ability of appropriate play materials in the 
PAT intervention group of the Teen PAT 
program, also was negative.*8 


Child Outcomes 


Given that changes in parenting knowledge, 
attitudes, and behaviors were the means by 
which improvements in child health and 
development were expected to occur, these 
small and inconsistent parenting outcomes 
would argue against seeing any systematic 
positive program benefits for children. 
However, Table 3 shows that small to moder- 
ate program benefits were found for some 
aspects of child development. 


PAT children in the Salinas Valley pro- 
gram benefitted significantly in the area of 
selfhelp development, advancing by approx- 
imately two months over the control group. 
Although not statistically significant, small 
positive effects on social development were 
noted for the children in the PAT groups in 
both studies. In Teen PAT, the children in the 
combined PAT-and-case-management group 
experienced statistically significant gains of 
one or more months over the control group 
in cognitive development, but the children 
in the PAT group experienced no significant 
benefits in cognitive development. 


In terms of child health and health care, 
no significant benefits were associated with 
PAT alone in either demonstration. In Teen 
PAT, the combined PAT-plus-case-manage- 
ment intervention was associated with signif 
icantly fewer opened cases of child abuse or 
neglect,*+ and the case management inter- 
vention was associated with a significantly 
higher rate of full immunization. 


More Detailed Analysis of 

Results Reveals Program Benefits 
Multivariate analyses were conducted to fur- 
ther explore the impact of the PAT pro- 
gram. Such analyses permitted researchers 
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Table 2 
Parenting Knowledge, Attitudes, and Behaviors Results for Parents as Teachers 
(PAT) Participant and Control Groups 
Salinas Valley PAT Teen PAT 
Rosa Control Control Case Combined 
PAT Group PAT° Group | Management® | Intervention® 
Parenting Knowledge 
Average percentage of Knowledge 66.4% 68.8% 64.5% 63.8% 63.1% 63.7% 
of Infant Development Inventory (-0.18) (0.05) (-0.05) (0.00) 
(KIDD parent knowledge items 
answered correctly 
Parenting Attitudes 
Total parental attitude scale 52.4 52.9 53.3 52.1 52.8 52.8 
(-0.06) (0.17) (0.11) (0.10) 
Parent satisfaction subscale 25.4 26.4 25.5 24,7 25.4 25.6 
(-0.18) (0.14) (0.12) (0.15) 
Parent efficacy subscale 27.1 26.6 27.8 27.4 27.4 27.3 
(0.15) (0.14) (0.00) (0.03) 
Parenting Behaviors/Home Environment 
Total Home Observation for 36.2 36.4 38.0 38.4 38.7 38.8 
Measurement of the Environment (-0.02) (-0.10) (0.05) (0.08) 
(HOME) scale 
Acceptance of child’s behavior 6.4° 6.7 6.4 6.2 6.4 6.6° 
subscale (-0.28) (0.11) (0.11) (0.30) 
Opportunity for stimulation subscale 3.4 3.5 40 3.7 3.7 40 
(-0.07) (0.19) (0.01) (0.25) 
Organization of the environment 5.7 5.7 5.7 5.7 5.8 5.8 
subscale (0.08) (-0.12) (0.24) (0.10) 
Parental involvement subscale 4.0 40 4.7 49 5.1 48 
(0.01) (-0.13) (0.16) (-0.09) 
Parental responsivity subscale 99 9.8 9.8 99 9.8 97 
(0.04) (-0.04) (-0.02) (0.07) 
Appropriate play materials subscale 6.7 6.7 7.5° 8.0 79 7.9 
(0.00) (-0.35) (-0.10) (-0.05) 
Sample size 202 148 90 96 88 89 
9 Effect sizes are in parentheses. See note no. 32 at the end of this article for a discussion of effect sizes. 
© Statistically significant difference from the control group in a one-tailed test at the p<.05 level. 


to control statistically for some of the possi 
ble effects of individual, family, and house- 
hold characteristics, such as age, language, 
and income, that might affect the out 
comes, either by creating spurious differ- 
ences between the PAT and control groups 
or by hiding real differences that might be 
present. Ideally, of course, random assign- 
ment would equalize the groups at the 
outset, and equivalence would be main- 
tained over time, such that statistical con- 
trols would not be necessary. But, as 
mentioned above, the groups did differ at 
the outset on a few characteristics, and this 


form of analysis provides an additional 
exploration of the data. 


Multivariate analyses were conducted 
for each parent and child outcome. For 
Salinas Valley PAT, characteristics held con- 
stant in the multivariate analysis were 
mother’s education, age, ethnicity, primary 
language, and selfreported experience 
with infants at enrollment; household 
income; child’s gender; divorce during the 
course of the demonstration project 
(which, as reported later, may have had a 
disturbing effect on children’s development); 
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Table 3 
Child Development and Health Outcomes for Parents as Teachers (PAT) 
Participant and Control Groups 
Salinas Valley PAT Teen PAT 
itcom 
Gulsomes Control Control Case Combined 
PAT Group PAT Group | Management® | Intervention® 
Cognitive Development 
Developmental Profile Il (DPI) scale -0.5 -1.1 2.4 2.2 3.5°° 3.4° 
score (0.10) (0.04) (0.32) (0.26) 
Bayley Scales of Infant Development 90.8 91.6 NA NA NA NA 
(BSID) mental development index (0.06) 
Communication Development 
DPIl months differential? 5.4 5.3 3.3 3.0 3.4 3.4 
(0.01) (0.05) (0.07) (0.06) 
Peabody Picture Vocabulary Test 0.3 -0.2 NA NA NA NA 
(PPVT) months differential? (0.06) 
Social Development 
DPIl months differentia 74 5.9 7.8 6.8 8.0 74 
(0.17) (0.14) (0.16) (0.08) 
Self-Help Development 
DPIl months differentia 13.0° 10.8 8.9 9.5 99 9.1 
(0.25) (0.10) (0.05) (-0.06) 
Physical Development 
DPIl months differentia 3.9 3.7 6.0 5.6 5.5 4.8 
(0.04) (0.07) (-0.02) (0.14) 
BSID physical development index 96.9 97.7 NA NA NA NA 
(-0.05) 
Child Health and Health Care 
Fully immunized for child’s age® 61.8 61.3 28.6 24.6 38.9° 33.3 
(0.01) (0.09) (0.31) (0.19) 
Treated for injury in the past year’ 8.1 11.9 25.7 28.6 10.0 16.2 
(0.12) (-0.06) (-0.48) (0.30) 
Had emergency room treatment in 20.3 24.5 NA NA NA NA 
past year (0.12) 
Had opened case of child abuse NA NA 1.3 24 2.7 0.0° 
or neglect (-0.08) (0.02) (-0.31) 
Sample sizes 
DPIL, injury, and emergency room 210 153 90 96 88 89 
treatment 
Immunizations 110 93 56 65 54 60 
Child abuse — = 149 163 148 138 
BSID 131 91 — — — — 
PPVT 188 132 — — — — 
2 Effect sizes are in parentheses. See note no. 32 at the end of this article for a discussion of effect sizes. 
© Bold type indicates statistically meaningful or significant differences. 
© Statistically significant difference from the control group in a one-tailed test at the p<.05 level. 
d DPIl and PPVT scores are presented as months differential, or the difference in months between a child’s chronological age 
and the age corresponding to the skill level assessed. For example, if a child was 12 months old but had the physical skills of a 15- 
month-old, the physical age score would be +3, or a positive differential of three months. If the child had the physical skills of a 
nine-month-old, the physical age score would be -3, or a negative differential of three months. 
© For Salinas Valley PAT, immunizations are those appropriate for three-year-olds; for Teen PAT, immunizations are age appropriate for two- 
year-olds. 
f For Salinas Valley PAT, past year care for three-year-olds was in the year preceding assessment. For Teen PAT two-year-olds, recent care 
was in the six months preceding assessment. 
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Table 4 


Results of Multivariate Analyses of Parent and Child 
Outcomes for Parents as Teachers (PAT) Participants 


Change in Dependent Variable Associated with 
Intervention (Versus Control Group) 
Outcomes Scminds Teen PAT 
pi Case Combined 
PAT Management |_ Intervention 
Parenting Outcomes 
Full Knowledge of Infant 0.6 14 0.6 -0.1 
Development Inventory (KID) 
score 
Parenting Sense of Competence 0.7 1.7 0.8 0.7 
(PSOC) full scale score 
Full Home Observation for 0.9 0.2 0.1 0.1 
Measurement of the Environment 
(HOME) score 
Child Development Outcomes 
Developmental Profile Il (DPID 1.5° 1.0 1.3° 1.4° 
Cognitive Development Scale 
Bayley Scales of Infant Development 0.4 NA NA NA 
(BSID) Cognitive Development Scale 
DPIl Communication Development 1.3 14 0.6 0.4 
Scale 
Peabody Picture Vocabulary Test 1.6 NA NA NA 
(PPVT) Language Test 
DPIl Social Development Scale 2.4° 15 1.3 0.9 
DPIl Self-Help Development Scale 2.3° 0.1 KI 0.3 
DPIl Physical Development Scale 1.2 0.2 0.2 0.2 
BSID Physical Development Scale -1.2 NA NA NA 


9 Statistically significant effect at the p=.05 level. 


and child care setting (centerbased care 
compared with any other type of care). In 
the Teen PAT multivariate analysis, factors 
included mother’s age, ethnicity, school 
attendance, pregnancy status, and self- 
reported experience with infants at enroll- 
ment; whether the father lived in the 
household; and whether the household 
received AFDC or welfare. 


In general, the results of these multivari- 
ate analyses, summarized in Table 4, sug- 
gested that participation in PAT conferred 
greater benefits than were apparent in the 
analyses of the entire randomized group. 
Although the multivariate analyses did not 
demonstrate significant positive impacts on 
parenting outcomes, the small negative 
effects associated with PAT in the initial 
analyses were eliminated or reduced. Parti- 


cipation in PAT was associated with a statisti- 
cally significant 1.3- to 1.5-month advantage 
in cognitive development over the control 
group for Salinas Valley PAT children and 
for Teen PAT case management and com- 
bined intervention children, as measured by 
the DPII (p<.05). 


In the areas of social and self-help devel- 
opment, participation in PAT was associated 
with statistically significant 2.4- and 2.3- 
month advantages, respectively, for Salinas 
Valley PAT children on the DPII (p<.05). 
With the exception of physical develop- 
ment, all relationships were positive in both 
studies, although no others were statistically 
significant. 


In sum, the analyses suggested that PAT 
alone produced modest benefits in the area 
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of child development (especially cognitive, 
social, and self-help) but no measurable ben- 
efits for parents or the home environment. 
In the Teen PAT Demonstration, children in 
the combined PAT-plus-case-management 
group were less likely to be subjects of child 
abuse investigations (p<.05). 


PAT Effectiveness for 


Families with Latina Mothers 
The Salinas Valley PAT Demonstration 
included (1) immigrant Latino families that 
were primarily Spanish-speaking, (2) Latino 
families whose primary language was 
English or that were bilingual, and (3) non- 
Latino families. It was therefore possible to 
examine the differential effectiveness of PAT 
among these groups.*° 


As Table 5 illustrates, families with 
Latina mothers were different in many 
respects from those with non-Latina moth- 
ers. Latino parents, as a group, were 


Children of Latina mothers derived greater 
benefit from the program than did children 
of non-Latina mothers, and children of 
Spanish-speaking Latinas benefitted most. 


younger, less well educated, less likely to be 
working, and less likely to be married than 
non-Latino parents. Latina mothers were 
less likely to be well informed about par- 
enting and children. 


However, Latina-mother families were 
not homogeneous. For example, primarily 
Spanish-speaking Latino parents (usually 
first-generation immigrants) were older and 
more likely to be married than their English- 
speaking or bilingual counterparts. They 
were less well educated, and mothers were 
less likely to be working and felt less 
informed regarding children and parenting. 
To the extent that these differences influ- 
enced the parent and child outcomes stud- 
ied, quite different results would be 
expected across these groups. 


Parenting Outcomes by Ethnic 
and Language Group 

Results indicated that the effects of PAT dif 
fered across ethnic and language subgroups 


of Salinas Valley participants. Specifically, as 
illustrated in Table 6, different patterns of 
effects were found among Latinas and non- 
Latinas in the areas of parent knowledge, 
attitudes, and behaviors. In general, it 
appears that PAT did not produce benefits 
for non-Latina families but did benefit 
Latina families. 


For example, non-Latina mothers in PAT 
scored significantly lower on the parent effi- 
cacy subscale of the PSOC Scale than their 
control group counterparts, while Latina 
mothers had significantly higher scores, par- 
ticularly those Latina mothers who were pri- 
marily English-speaking or _ bilingual. 
Non-Latina PAT mothers also scored worse 
than non-Latina control group mothers on 
the total HOME parenting behavior scale 
and several of its subscales, but there were 
essentially no differences between Latina 
PAT and control group mothers on the 
HOME and its subscales. 


Child Outcomes by Ethnic and 
Language Group 

Table 7 compares child outcomes for each 
of the ethnic and language subgroups. 
Results indicated that children of Latina 
mothers derived greater benefit from the 
program than did children of non-Latina 
mothers, for whom program effects often 
were negative, and that children of 
Spanish-speaking Latinas benefitted most. 
For example, a statistically significant posi- 
tive effect was noted for the cognitive devel- 
opment of children of Latina mothers as 
measured by the DPII but not for children 
of non-Latinas. Although these children’s 
cognitive development lagged behind their 
chronological age (that is, there was a neg- 
ative months differential DPII score on cog- 
nitive development), the lag was 1.4 
months smaller for children of Latina 
mothers in the PAT group than for chil- 
dren of Latina control group mothers. The 
effect size was somewhat larger for children 
of Spanish-speaking Latina mothers than 
for children of English-speaking or bilin- 
gual Latinas (0.32 versus 0.23). Children of 
Spanish-speaking Latinas outscored their 
control group counterparts on the mental 
development subscale of the BSID by 
almost six IQ points, while PAT children of 
non-Latina mothers actually scored about 
four points lower than their control group 
counterparts. 
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Table 5 
Characteristics of Salinas Valley Parents as Teachers (PAT) Mothers at 
Enrollment, by Ethnicity and Primary Language 
Ethnicity and Primary Language of Mothers 
Characteristics English- 
Spanish- Speaking 
Speaking or Bilingual 
Non-Latina Latina Latina Latina 
Average Age 
Mother 27.3° 25.2° 26.8 23.2° 
Father 30.6 277° 29.5 25.6° 
Household Composition 
Mother was married 71.6° 53.5 67.1 37.2° 
Father lived in the household 80.0° 70.6 82.7 56.3° 
Married, two-parent household 69.5 56.0° 66.7 36.8° 
Mother was only adult in 5.3° 12.2 7.8 17.5° 
household 
Child had siblings 43.2° 55.2 61.6 47.5° 
Highest Education Level 
Mother 
Less than high school 12.6 69.2° 84.0 51.4 
High school only 20.0 18.4 11.9 26.2° 
Any postsecondary education 67.4 12.4° 4.1 22.4° 
Father 
Less than high school 12.5 70.3" 81.5 56.3 
High school only 25.0 19.4 12.4 28.2” 
Any postsecondary education 62.5 10.3° 6.2 15.5 
Economic Status 
Mother was working or in job 46.3 18.2° 9.6 28.4° 
training 
Father was working or in job 86.5 66.3° 68.3 63.8 
training 
Household received AFDC 15.8 21.6 11.9 33.3° 
Household had Medi-Cal 35.8 66.7° 73.5 58.5° 
Mother’s Knowledge and 
Information-Gathering Behavior 
About Children or Parenting 
Ever taken a class on child care 39.8 13.0° 1.8 26.5" 
Assessed own knowledge of 20.0 10.8 2.8 20.7° 
infants as “high” 
Mean scale score for general 13.8 12.1° NA NA 
information-seeking behavior? 
Sample size 
Mothers 95 402 219 183 
Fathers 92 34] 187 154 
a Bold type indicates statistically meaningful or significant differences. 
© Statistically significant difference between groups in a two-tailed test at the p<.05 level. 
° p<.001 
qd p<.01 
e Many parents actively sought information about children and parenting from a variety of sources, most commonly friends 
and relatives. To obtain a picture of the overall level of information seeking by parents about children and parenting, a 
scale was created specifically for the study in which a value of 1 was assigned for seeking information less than monthly, 
a value of 2 for seeking information monthly, 3 for weekly information seeking, and 4 for more frequent than weekly infor- 
mation seeking. Summing values for the five sources results in a scale that ranges from 5 to 25, with a mean of 12.4. 


105 


106 THE FUTURE OF CHILDREN - SPRING/SUMMER 1999 


Table 6 


Parenting Outcomes for Salinas Valley Parents as Teachers (PAT) Participant and 
Control Groups by Mother’s Ethnicity and Primary Language 


Children of 
Non-Latina Spanish-Speaking | English-Speaking 
Outcomes Mothers Latina Mothers Latinas or Bilingual Latinas 
Control Control Control Control 


PAT° Group PAT Group PAT° Group PAT° Group 


Parenting Knowledge 
Average percentage of Knowledge | 81.0% 80.0% 63.4% 65.1% 59.5% 61.5% 68.3% 69.8% 
of Infant Development Inventory (0.10) (-0.15) (-0.18) (0.15) 
(KIDD parent knowledge items 
answered correctly 


Parenting Attitudes 
Total parental attitude scale 56.3 58.0 51.6 ror 49,2 49,2 54.5 53.6 
(0.28) (0.06) (0.01) (0.12) 
Parent satisfaction subscale 27.8 29.0 24.9 25.6 23.3 24.5 26.8 26.9 
(0.28) (0.12) (-0.22) (-0.01) 
Parent efficacy subscale 28.5 29.0 26.8°° | 25.8 26.0 25.1 27.8° 26.6 
(-0.20) (0.30) (0.27) (0.35) 
Parenting Behaviors 
Total Home Observation for 40.5 41.8 35.4 34.6 35.2 34.4 35.8 34.8 
Measurement of the Environment (-0.32) (0.15) (0.14) (0.14) 
(HOME) scale 
Acceptance of child’s behavior 7.2° 7.7 6.3 6.4 6.2 6.4 6.3 6.4 
subscale (-0.66) (0.13) (-0.23) (-0.04) 
Opportunity for stimulation subscale 4.0 4.3 3.3 3.3 3.4 3.4 3.3 3.1 
(-0.30) (0.03) (-0.04) (0.12) 
Organization of the environment 5.6 5.9 5.8 5.6 59 5.8 5.5 5.3 
subscale (-0.45) (0.19) (0.21) (0.24) 
Parental involvement subscale 48 5.1 3.8 3.6 3.8 3.3 3.9 3.9 
(0.24) (0.14) (0.23) (0.00) 
Parental responsivity subscale 10.1 10.5 98 9.6 10.1 99 9.6 9.1 
(-0.30) (0.14) (0.08) (0.22) 
Appropriate play materials subscale 8.6 8.4 6.4 6.2 5.8 5.5 71 7.0 
(0.18) (0.10) (0.13) (0.04) 
Language- and literacy-promoting 7.3 74 5.5 5.2 5.2 47 5.9 6.0 
behaviors (-0.07) (0.14) (0.26) (-0.02) 
Mother-child interaction 5.1 5.5 §.2 5.1 5.4 5.3 49 48 
(-0.18) (0.07) (0.06) (0.09) 
Discipline 5.7° 6.0 57 58 5.8 5.9 5.6 57 
(-0.64) (0.19) (-0.29) (-0.10) 
Sample size 35 37 167 11] 93 63 74 48 


° Effect sizes are in parentheses. See note no. 32 at the end of this article for a discussion of effect sizes. 
© Bold type indicates statistically meaningful or significant differences. 
© Statistically significant difference from the control group in a one-tailed test at the p<.01 level. 
d 
p<.05 
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Table 7 
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Child Development Outcomes for Salinas Valley Parents as Teachers (PAT) 
Participant and Control Groups by Mother’s Ethnicity and Primary Language 


Children of 
Non-Latina Spanish-Speaking | English-Speaking 
Outcomes Mothers Latina Mothers Latinas or Bilingual Latinas 
Control Control Control Control 
PAT° Group PAT° Group PAT Group PAT Group 
Cognitive Development 
Developmental Profile Il (DPII) 5.1 47 “1.7°°] -3.1 -2.8° -4.1 0.4 -1.9 
months differential? (0.06) (0.26) (0.32) (0.23) 
Bayley Scales of Infant Development 99.6 104.4 88.9 86.0 86.7 80.9 914 92.4 
(BSID) mental development index (-0.37) (0.22) (0.50) (0.08) 
Communication Development 
DPIl months differential 8.4 9.3 47 3.9 5.2 4.2 4.2 3.6 
(-0.09) (0.10) (0.13) (0.07) 
Peabody Picture Vocabulary Test 0.9 1.4 0.2 -0.8 4.1° 1.4 -4,7 -3.8 
(PPVT) months differential (-0.06) (0.11) (0.36) (0.11) 
Social Development 
DPIl months differential 8.8 9.8 7.1° 4.6 8.2° 5.7 5.7 3.2 
(0.13) (0.28) (0.31) (0.26) 
Self-Help Development 
DPIl months differential 9.7 8.9 13.7° 11.4 16.0 13.7 10.9 8.4 
(0.10) (0.25) (0.27) (0.25) 
Physical Development 
DPIl months differential 6.7 5.2 3.3 3.2 3.4 3.8 3.2 2.3 
(0.23) (0.03) (-0.09) (0.15) 
BSID physical development index 100.4° 106.5 96.1 93.8 94.3 88.1 98.2 100.9 
(-0.50) (0.13) (0.33) (0.19) 
Sample sizes 
DPIl 36 38 174 115 96 64 78 5] 
BSID 23 28 108 63 58 35 50 28 
PPVT 30 33 158 99 88 58 70 Al 


° Effect sizes are in parentheses. See note no. 32 at the end of this article for a discussion of effect sizes. 


© DPIl and PPVT scores are presented as months differential, or the difference in months between a child’s chronological age and the age 
corresponding to the skill level assessed. For example, if a child was 12 months old but had the physical skills of a 15-month-old, the physi- 
cal age score would be +3, or a positive differential of three months. If the child had the physical skills of a nine-month-old, the physical 
age score would be a -3, or a negative differential of three months. 


© Bold type indicates statistically meaningful or significant differences. 


4 Statistically significant difference from the control group in a one-tailed test at the p<.05 level. 


8 9<.01 


Additional significant program benefits 
to children of Latina mothers were found 
on the DPII scales of social and selfhelp 
development, with differences between PAT 
and control group children of 2.5 and 2.3 
months, respectively. Again, effects were 
marginally larger for children of Spanish- 
speaking Latina mothers. Moderate and sig- 
nificant benefits also were noted for 
children of Spanish-speaking Latina moth- 


ers on the PPVT and on the physical devel- 
opment subscale of the BSID. Thus, several 
developmental benefits occurred for chil- 
dren of Latina mothers, particularly those 
who were primarily Spanish-speaking. 
These benefits had not been apparent in 
earlier analyses because they had been over- 
shadowed by the poor outcomes experi- 
enced by the children of non-Latina 
mothers. 
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The poor outcomes for non-Latina 
mothers and their children may have been 
related to the markedly higher rate of mari- 
tal instability among non-Latinas during the 
demonstration. Whereas 76% of non- 
Latinas in the PAT group were married at 
enrollment, 8% experienced divorce or sep- 
aration during the course of the interven- 
tion. This contrasts sharply with the steady 
increase of up to 14 percentage points in the 
marriage rate (that is, more mothers were 
married) in the non-Latina control group 
and among the English-speaking, Spanish- 
speaking, and bilingual Latina participant 
and control groups between enrollment and 
the third assessment. (These data do not 
appear in any table.) 


Multivariate analyses (also not reported 
in the tables) demonstrated that marital dis- 
solution had a significant negative impact 
on several outcomes for children, control 
ling for other factors. For example, for 
non-Latina mothers, experiencing divorce 
during the demonstration resulted in seven 


Eleven percent of attempted home visits by 
Teen PAT parent educators were “no-shows.” 


fewer points on the total score for the 
HOME Inventory, and 11 fewer points on 
the PPVT for children.** Thus, a greater inci- 
dence of divorce among non-Latina partici- 
pants relative to non-Latina control group 
members may have contributed to poor par- 
ticipant outcomes for that group. 


Variations in Program 
Exposure Influence 


Outcomes 


Existing studies of the effectiveness of PAT 
and home visiting in general have tended to 
consider the intervention as a “black box.” 
Little is known about variations in the ways 
families experience home visiting programs 
and the differences those variations make in 
the outcomes children and families achieve. 


One clear difference in families’ experi- 
ences of PAT was the degree to which they 
were exposed to the PAT curriculum 
through home visits. In any program, some 
percentage of enrollees discontinue their 
participation before the program is com- 


pleted. As discussed earlier, 43% of families 
that were assigned to the participant group 
in the Salinas Valley PAT Demonstration 
dropped out of the intervention before 
the children reached their third birthdays, 
and 57% of the teens in the three interven- 
tion groups (PAT, case management, and 
PAT plus case management) in the Teen PAT 
Demonstration dropped out before the chil- 
dren’s second birthdays. 


Even among those who persisted in the 
program, other variations in exposure 
occurred because families were not always 
able to keep their home visit appointments. 
For example, 11% of attempted home visits 
by Teen PAT parent educators were “no- 
shows,” that is, the teen was not home when 
the parent educator arrived for the arranged 
visit. Case managers had about 35% of their 
attempted home contacts end as no-shows 
for the case management and combined 
intervention groups. More than 40% of 
Salinas Valley PAT families that persisted 
through the children’s third birthdays had 
gaps of four months or more in their home 
visits, largely because many families returned 
to Mexico for extended periods each winter. 


These kinds of variations resulted in con- 
siderably reduced exposure to the program 
for all groups when compared to the 
monthly home visits intended by program 
planners at these sites. Salinas Valley PAT 
families as a whole averaged almost 20 home 
visits in three years, with those that com- 
pleted the program (n=169) averaging 28 
visits, as compared with 8 visits for dropouts 
(n=129). Teen PAT families averaged 10 
home visits and/or in-person case manage- 
ment contacts. Those that persisted through 
the children’s second birthdays (n=76 for 
the PAT group, 64 for the case management 
group, and 84 for the combined interven- 
tion) averaged about three times the expo- 
sure of both home visits (16) and case 
management contacts (17 and 14 contacts, 
respectively, for the case management and 
combined intervention groups) as did 
dropouts (n=92 for the PAT group, 105 for 
the case management group, and 89 for the 
combined intervention group), with an aver- 
age of five home visits and/or case manage- 
ment contacts. Given the high proportion of 
families that dropped out of their programs 
and the relatively low level of program ser- 
vice that dropouts experienced, it is impor- 


tant to assess whether PAT achieved more 
substantial impacts when experienced at a 
higher level of exposure. 


In the Salinas Valley PAT Demonstration, 
parent and child outcomes for families that 
had dropped out of the program and fami- 
lies that persisted in the program were ana- 
lyzed separately to determine whether each 
group had significantly better outcomes 
than control group members. A more fine- 
grained analysis was conducted to deter 
mine whether the number of home visits 
that families received contributed signifi- 
cantly to parent and child outcomes relative 
to no home visits (that is, the control group). 


In the Teen PAT Demonstration, the 
effect on parent and child outcomes of 
receiving the intended level of program ser- 
vice as compared with not receiving the 
intended level of program service was exam- 
ined. For the PAT group, the intended level 
of program service as defined by the Parents 
as Teachers National Center (PATNC) was 
17 home visits for each family through the 
children’s second birthdays.*” For the case 
management group, four personal contacts 
per year was the minimum acceptable level 
of service as determined by the state funding 
agency for those services. For the combined 
intervention group, both thresholds needed 
to be met for a family to be considered to 
have received the intended level of program 
service. 


Families that participated more in the 
programs may have differed from other fam- 
ilies in ways other than the level of services 
they received. Because these differences may 
have influenced outcomes, multivariate 
analyses that controlled for a variety of indi- 
vidual characteristics**> were conducted. 
However, even though the influence of 
important measurable differences between 
families that may have affected their out 
comes was taken into consideration, it is pos- 
sible that unmeasured factors may have 
distinguished high-exposure families and 
influenced the relationship between pro- 
gram exposure and outcomes. 


Results of Analyses Concerning 
Program Exposure 

Neither demonstration found that greater 
exposure to program services was related to 
greater parenting impacts. Although virtu- 
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ally all relationships between having greater 
exposure to a program and parenting out- 
comes were positive, in no case did they 
reach statistical significance, controlling for 
other factors. 


However, Table 8 illustrates that the level 
of service participants received did relate to 
the level of benefit to children. In the Salinas 
Valley Demonstration, persisting in PAT 
through the children’s third birthdays was 
significantly related to higher DPII scores in 
the cognitive, social, and self-help domains. 
Persisting to the end of the intervention 
(rather than being in the control group) was 


Home visits were associated with a one- 
month developmental advantage per 10 
home visits in the cognitive, social, and self- 
help domains for children in the PAT 
participant group in the Salinas Valley study. 


associated with a developmental advantage 
of 1.7 to 2.6 months across these domains, 
controlling for other factors. Similarly, each 
home visit was associated with a significant 
benefit in these domains. Home visits were 
associated with a one-month developmental 
advantage per 10 home visits in the cogni- 
tive, social, and selfhelp domains for chil- 
dren in the PAT participant group in the 
Salinas Valley study. 


Findings regarding exposure to program 
services were less consistent in the Teen PAT 
Demonstration. Only in the case of cognitive 
development as measured by the DPII was 
the impact of receiving the intended level of 
services statistically significant, controlling 
for other factors in the analyses. Receiving 
the intended level of exposure was associ- 
ated with a 1.6-month developmental 
advantage for children assigned to the 
case management group (p<.05) and a 
1.7-month developmental advantage for 
children assigned to the combined PAT-plus- 
case-management group (p<.10). No impact 
was noted for children in the PAT-alone 
group, even when the intended number of 
home visits was made. 


The inconsistent findings regarding the 
influence of the level of program exposure 
on outcomes mirror the inconclusiveness of 
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Table 8 


Relationship of Intervention Intensity to Child Development Outcomes for 
Participants in Salinas Valley Parents as Teachers (PAT) and Teen PAT 


Developmental Domain 
Outcomes Cognitive Social | Self-Help} Communication Physical 
DPII° BSID° DPIl DPII DPII PPVT° DPIl BSID 
Salinas PAT 
Change in development score 
associated with 
Being a dropout (versus control 0.7 0.8 2.2 0.9 1.7 -2.0 0.5 2:5 
group) 
Being a persister (versus control Pag 0.4 2.5° 2.6° 1.2 2.3° 13 “17 
group) 
Each home visit 0.1° 0.0 0.1° 0.1° 0.0 0.1° 0.1° -0.1 
Teen PAT 
Change in months differential? 
associated with expected level 
of intensity of 
PAT 0.0 NA 0.2 0.2 1.2 NA -14 NA 
Case management 1.6° NA 1.7 1.7 09 NA 0.1 NA 
Combined intervention “7 NA 2 0.4 0.2 NA -0.6 NA 
2 DPIl refers to the Developmental Profile Il scale; BSID refers to the Bayley Scales of Infant Development; PPVT refers to the Peabody Picture 


Vocabulary Test. 
© Statistically significant relationship at the p<.05 level. 


© p<.01 


d DPIl scores are presented as months differential, or the difference in months between a child’s chronological age and the age corresponding 
to the skill level assessed. For example, if a child was 12 months old but had the physical skills of a 15-month-old, the physical age score would 
be +3, or a positive differential of three months. If the child had the physical skills of a nine-month-old, the physical age score would be a -3, 
or a negative differential of three months. 


other home visiting and family support 
research, in which intensity has been found 
to contribute to greater impact in some 
studies*? but not in others.” 


Summary 

The Salinas Valley PAT Demonstration 
focused on the effectiveness of PAT for a 
largely Latino group of families, and the Teen 
PAT Demonstration examined the effective- 
ness of PAT alone and in combination with 
case management services for teen parents 
and their children. Members of both popula- 
tions have a variety of characteristics that may 
make them difficult to serve. Given the youth 
and developmental stage of teen parents, a 
two-year commitment to an intervention pro- 
gram was truly challenging to sustain. In both 
groups, poverty, household instability, and 
poor education were common. These factors 
undoubtedly contributed to the fact that fam- 
ilies’ actual exposure to the PAT curriculum 
was considerably lower than intended. 


Thus, with the challenging populations 
served and the difficulty in providing the 
intended level of service, it is not surprising 
that the overall effects of PAT in both demon- 
strations were not large. Neither demonstra- 
tion achieved consistent positive effects on 
parenting knowledge, attitudes, or behaviors. 
Some benefits to children in the area of child 
development were identified in both demon- 
strations, although they were small and not 
consistent across developmental domains. 
These benefits appeared stronger when 
demographic and other factors were con- 
trolled for in multivariate analyses. 


These results from the evaluations of 
the Salinas Valley and Teen PAT Demon- 
strations are consistent with the overall 
research base for family-focused early child- 
hood programs, which have produced 
“modest and inconsistent effects.”4! A 
review of randomized trials of 15 home vis- 
iting programs for low-income families that 


assessed parenting impacts found positive 
effects for only eight programs, and signifi- 
cant short-term effects on children’s cogni- 
tive or behavioral development in less than 
half of the randomized trials that assessed 
such outcomes.*? 


However, the Salinas Valley PAT Demon- 
stration revealed that families differed in the 
extent to which they benefitted from PAT. 
Outcomes of all kinds were more positive for 
families with Latina mothers (relative to a 
Latina control group) than for those with 
non-Latina mothers (relative to their non- 
Latina peers), with the exception of the par 
enting knowledge score. However, parenting 
impacts were weak and somewhat inconsis- 
tent, even for Latina mothers. The impact on 
child development, which was stronger than 
the impact on parenting in the demonstra- 
tion overall, was consistently positive and in 
many cases statistically significant for chil 
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mented in this demonstration project to 
teen parents. Teens are a challenging group 
to engage and retain, and analyses showed 
little or no benefit on most outcome mea- 
sures for either parents or children from 
PAT services, either alone or in combination 
with case management services. Some of this 
may result from the small percentage of fam- 
ilies that actually received the intended level 
of service. However, controlling for other 
factors, a greater exposure to home visits was 
not significantly related to better teen parent 
or child outcomes. 


It is important to note, however, that the 
Teen PAT Demonstration implemented 
the general PAT curriculum. Subsequently, 
the PATNC launched a new curriculum and 
training program for parent educators who 
serve teen parents, recognizing the increased 


11] 


dren of Latina mothers, particularly those 2e PATNC launched a new curriculum and 
who were primarily Spanish-speaking. training program jor parent educators who 
Children of Latina mothers had moderate serve teen pa: ts, recognizing thes iced 
or statistically significant positive effects in . : 
three of the five developmental domains challenges and specific curricular and 


examined (cognitive, social, and selfhelp); pedagogic emphases needed jor that group. 


children of those who were primarily 
Spanish-speaking benefitted significantly in 
four of the five domains (cognitive, commu- 
nication, social, and self-help). 


Thus, the Salinas Valley PAT Demon- 
stration offered some support for the notion 
that PAT could usefully be targeted to fami- 
lies of Latino parents with limited English 
proficiency, particularly if they could be 
retained in the program through comple- 
tion so that they received a substantial 
number of home visits. Analyses of the 
impact of increased exposure in the Salinas 
Valley Demonstration suggested that com- 
pleting the program, receiving more home 
visits, and receiving more home visits tar- 
geted to particular developmental domains 
enhanced the benefits to children’s develop- 
ment in several areas. In the time since the 
Salinas Valley Demonstration, the PATNC 
has recommended that local programs pro- 
vide home visits at frequencies in accor- 
dance with individual family needs, whether 
monthly, biweekly, or weekly. 


On the other hand, there was little evi- 
dence in the Teen PAT Demonstration to 
support targeting the PAT program as imple- 


challenges and specific curricular and peda- 
gogic emphases needed for that group. (See 
Appendix B in this journal issue.) It is 
unknown whether home visits using that cur- 
riculum would result in more substantial 
benefits for teen parents or their children. 


Finally, the two demonstrations raised 
questions about the fundamental premise of 
PAT: that focusing services on parents to 
improve parenting knowledge, attitudes, 
and behaviors is an effective way to benefit 
children. In Salinas Valley PAT, both for the 
demonstration overall and for the more 
powerfully impacted group of Latina moth- 
ers and their children, benefits for children 
were identified without a corresponding 
pattern of positive impacts on parents. 
Although it is quite possible that parent 
impacts occurred that were not captured by 
the measurement tools employed, it is also 
possible that PAT benefitted children directly 
in ways that are not clearly understood. 


Whatever the explanation, these findings 
support an emerging conclusion regard- 
ing parent- and child-focused programs: 
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“Theoretically, involving parents, changing 
parenting attitudes and behaviors, and 
improving parent-child interactions should 
have both short- and long-term positive 
effects on child development. . . .However, 
there is little research evidence to support 
the assumption that parent services affect 
child outcomes.”4 


Thus, unanswered questions remain 
regarding the extent to which PAT supports 
the positive development of young children, 
the kinds of children and families that ben- 
efit, and the ways in which those benefits are 
achieved. In an effort to continue to develop 
the research base regarding PAT, the pro- 


gram is being evaluated in a randomized 
trial in three urban locations around the 
country with high proportions of low- 
income and minority families.“4 This study 
will employ additional measures of parent- 
child interactions and will allow further 
exploration of the effectiveness of PAT for 
these families. Further, the measurement 
battery in the new study is being enhanced 
for the measurement of parent-child inter- 
actions in an effort to better understand 
the influence of PAT on the intersection 
between parent behavior and child devel- 
opment. Findings from the current 
demonstration are expected to be released 
in 2001. 


. Additional Parents as Teachers program goals, as stated in Appendix B in this journal issue, 
are to (1) empower parents to give children the best start in life, (2) develop home-school- 
community partnerships on behalf of children, and (3) prevent and reduce child abuse. 
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Although PAT services normally are extended to families through children’s third birthdays, 
and case management services are offered to teens through age 18, the funding for the ser- 
vices component of the demonstration from the California Office of Child Abuse Prevention 
was sufficient to serve families only through children’s second birthdays. Thus, the findings 
reported here may not reflect the impacts that the full-term services would have achieved for 
parents or children. 


In the Teen PAT study, changes in maternal life course also were assessed (for example, 
changes in maternal enrollment in school, welfare receipt, education, and marital status; and 
repeat pregnancies and births). These results are summarized in Appendix B in this journal 
issue but are not reported here because they are outcomes that were hypothesized to occur as 
a result of the case management services afforded the teen mothers, rather than the PAT 
home visiting services. Generally, the PAT, case management, and combined PAT-plus-case- 
management groups showed few significant benefits over the control group in terms of 
maternal life course outcome. 
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Results from the two evaluations were analyzed and reported in several ways. T tests were used 
to compare the experimental and control groups. Results are reported in Tables 2 and 3. The 
tables highlight findings in which the T tests suggested that true differences between the 
groups existed at a probability of p<.05. 

Because p values depend on sample size, small groups may make it hard to achieve signifi- 
cant p values, even when differences exist between experimental and control groups. Effect 
size is a statement of the magnitude of the difference between two groups and is not depen- 
dent upon group size. Effect sizes often are reported, therefore, when studies have small sam- 
ples to help identify where meaningful effects may have occurred. These effects are reported 
in Tables 2, 3, 6, and 7. 

The following can serve as a gauge of the importance of any particular effect: For the 
parent outcomes and the child development outcomes, an effect size of 0.1 to 0.3 is consid- 
ered small, 0.31 to 0.5 is considered moderate, and greater than 0.5 is considered large. For 
the child health and health care outcomes, an effect size of 0.2 to 0.49 is considered small, 0.5 
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“yes” or “no” variable, or an ordinal variable, such as a test score from a scale of possible 
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Multivariate analyses (ordinary least-squares regressions, or logistic regressions) were also 
used to control for individual, family, and household characteristic differences between the 
participant and control groups that might be related to observed outcomes, and to attempt to 
quantify the magnitude of change that a single unit of the intervention could be expected 
to produce. For example, analyses were conducted to suggest how many home visits would be 
needed to produce one month of developmental advantage for children. 


Multivariate analyses confirmed these effects, finding no significant relationship between 
interventions and parent outcomes, controlling for individual and household characteristics. 


An “opened case” of child abuse or neglect is a report of abuse or neglect for which there is 
enough confirming evidence to support an official case file and a complete investigation by 
child protective services. Not all opened cases are subsequently substantiated in the investiga- 
tions. Given the considerable length of time that cases often remain open, it was not possible 
to determine substantiation during the demonstration period. 


A similar analysis of ethnic group differences was not conducted for the Teen PAT 
Demonstration because the ethnicity of mothers in that demonstration project was seriously 
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confounded with the local programs that served them. For example, virtually all African- 
American teens were recruited from a single program; a majority of Caucasian teens were 
recruited from one other program. This made it impossible to distinguish the influence of 
individual site differences from that of ethnicity. 


A series of multivariate analyses were conducted that statistically controlled for the effects of 
the mother’s education, age, primary language, and self-reported experience with infants at 
enrollment; household income; and the child’s gender to determine whether the dissolution 
of marriage during the demonstration project had an effect on each of the outcomes for chil 
dren. See note no. 32 for detailed descriptions of these analyses and results. 
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